Evaluation problemorientierten Lernens im Münchner Modell der Medizinerausbildung - Bewertung durch die Studierenden (1997 bis 2001)

This research report is concerned with the evaluation of problem-oriented learning in medicine, i.e. the Munich Model of medicine education. First, key concepts of problem-oriented learning and their realisation in medical education are outlined. Then, the Munich Model of medicine education which has been established in cooperation with the Harvard Medical School, Boston, is described. Four problem-oriented courses are part of this model. Approximately 1.500 students participated in these courses. The aim of the evaluation is to provide a basis for improving the quality of the four problem-oriented courses. Evaluation dimensions are acceptance, subjective learning gains, group cooperation and tutor's support. The report shows the students' ratings of all courses conducted since 1997. The evaluation results are described for each course. Furthermore, between-course comparisons are reported. In general, students are very satisfied with the courses. Findings are discussed and future research is outlinedIn diesem Forschungsbericht wird die Evaluation des Münchner Modells problemorientierten Lernens in der Medizin beschrieben. Zunächst werden Schlüsselkonzepte problemorientierten Lernens und deren Umsetzung in der Medizinerausbildung dargestellt. Danach wird das Münchner Modell der Medizinerausbildung erläutert, in dem vier problemorientierte Kurse realisiert werden. Dieses wurde in Kooperation mit der Harvard Medical School, Boston, entwickelt. An den vier Kursen nahmen bisher insgesamt annähernd 1.500 Studierende teil. Ziel der Evaluation ist es, eine Grundlage zur weiteren Qualitätsverbesserung der vier problemorientierten Kurse bereitzustellen. Die Studierenden bewerten im Rahmen der Evaluation die Dimensionen Akzeptanz, subjektiver Lernerfolg, Gruppenkooperation und Betreuung durch den Tutor. In diesem Bericht werden die Teilnehmerbewertungen aller Kurse seit 1997 dargestellt. Die Evaluationsergebnisse werden für jeden Kurs erläutert. Darüber hinaus werden Vergleiche zwischen den Kursen berichtet. Insgesamt sind die Studierenden sehr zufrieden mit den Kursen. Die Befunde werden in Zusammenhang mit Fragestellungen zukünftiger Forschung diskutier

High-fidelity simulation increases obstetric self-assurance and skills in undergraduate medical students

Objective: Teaching intrapartum care is one of the most challenging tasks in undergraduate medical education. High-fidelity obstetric simulators might support students' learning experience. The specific educational impact of these simulators compared with traditional methods of model-based obstetric teaching has not yet been determined. Study design: We randomly assigned 46 undergraduate medical students to be taught using either a high-fidelity simulator or a scale wood-and-leather phantom. Their self-assessments were evaluated using a validated questionnaire. We assessed obstetric skills and asked students to solve obstetric paper cases. Main outcome measures: Assessment of fidelity-specific teaching impact on procedural knowledge, motivation, and interest in obstetrics as well as obstetric skills using high- and low-fidelity training models. Results: High-fidelity simulation specifically improved students' feeling that they understood both the physiology of parturition and the obstetric procedures. Students in the simulation group also felt better prepared for obstetric house jobs and performed better in obstetric skills evaluations. However, the two groups made equivalent obstetric decisions. Conclusion: This study provides first data on the impact of high-fidelity simulation in an undergraduate setting

Pick-N multiple choice-exams: a comparison of scoring algorithms

To compare different scoring algorithms for Pick-N multiple correct answer multiple-choice (MC) exams regarding test reliability, student performance, total item discrimination and item difficulty. Data from six 3rd year medical students' end of term exams in internal medicine from 2005 to 2008 at Munich University were analysed (1,255 students, 180 Pick-N items in total). Scoring Algorithms: Each question scored a maximum of one point. We compared: (a) Dichotomous scoring (DS): One point if all true and no wrong answers were chosen. (b) Partial credit algorithm 1 (PS(50)): One point for 100% true answers; 0.5 points for 50% or more true answers; zero points for less than 50% true answers. No point deduction for wrong choices. (c) Partial credit algorithm 2 (PS(1/m)): A fraction of one point depending on the total number of true answers was given for each correct answer identified. No point deduction for wrong choices. Application of partial crediting resulted in psychometric results superior to dichotomous scoring (DS). Algorithms examined resulted in similar psychometric data with PS(50) only slightly exceeding PS(1/m) in higher coefficients of reliability. The Pick-N MC format and its scoring using the PS(50) and PS(1/m) algorithms are suited for undergraduate medical examinations. Partial knowledge should be awarded in Pick-N MC exams

Answer changing in multiple choice assessment change that answer when in doubt – and spread the word!

<p>Abstract</p> <p>Background</p> <p>Several studies during the last decades have shown that answer changing in multiple choice examinations is generally beneficial for examinees. In spite of this the common misbelief still prevails that answer changing in multiple choice examinations results in an increased number of wrong answers rather than an improved score. One suggested consequence of newer studies is that examinees should be informed about this misbelief in the hope that this prejudice might be eradicated. This study aims to confirm data from previous studies about the benefits of answer changing as well as pursue the question of whether students informed about the said advantageous effects of answer changing would indeed follow this advice and change significantly more answers. Furthermore a look is cast on how the overall examination performance and mean point increase of these students is affected.</p> <p>Methods</p> <p>The answer sheets to the end of term exams of 79 3^rdyear medical students at the University of Munich were analysed to confirm the benefits of answer changing. Students taking the test were randomized into two groups. Prior to taking the test 41 students were informed about the benefits of changing answers after careful reconsideration while 38 students did not receive such information. Both groups were instructed to mark all answer changes made during the test.</p> <p>Results</p> <p>Answer changes were predominantly from wrong to right in full accordance with existing literature resources. It was shown that students who had been informed about the benefits of answer changing when in doubt changed answers significantly more often than students who had not been informed. Though students instructed on the benefits of changing answers scored higher in their exams than those not instructed, the difference in point increase was not significant.</p> <p>Conclusion</p> <p>Students should be informed about the benefits of changing initial answers to multiple choice questions once when in reasonable doubt about these answers. Furthermore, reconsidering answers should be encouraged as students will heed the advice and change more answers than students not so instructed.</p

THE NATURAL HISTORY OF MODEL ORGANISMS Insights into the evolution of social systems and species from baboon studies

International audienceBaboons, members of the genus Papio, comprise six closely related species distributed throughout sub-Saharan Africa and southwest Arabia. The species exhibit more ecological flexibility and a wider range of social systems than many other primates. This article summarizes our current knowledge of the natural history of baboons and highlights directions for future research. We suggest that baboons can serve as a valuable model for complex evolutionary processes, such as speciation and hybridization. The evolution of baboons has been heavily shaped by climatic changes and population expansion and fragmentation in the African savanna environment, similar to the processes that acted during human evolution. With accumulating long-term data, and new data from previously understudied species, baboons are ideally suited for investigating the links between sociality, health, longevity and reproductive success. To achieve these aims, we propose a closer integration of studies at the proximate level, including functional genomics, with behavioral and ecological studies

Common Limitations of Image Processing Metrics:A Picture Story

While the importance of automatic image analysis is continuously increasing, recent meta-research revealed major flaws with respect to algorithm validation. Performance metrics are particularly key for meaningful, objective, and transparent performance assessment and validation of the used automatic algorithms, but relatively little attention has been given to the practical pitfalls when using specific metrics for a given image analysis task. These are typically related to (1) the disregard of inherent metric properties, such as the behaviour in the presence of class imbalance or small target structures, (2) the disregard of inherent data set properties, such as the non-independence of the test cases, and (3) the disregard of the actual biomedical domain interest that the metrics should reflect. This living dynamically document has the purpose to illustrate important limitations of performance metrics commonly applied in the field of image analysis. In this context, it focuses on biomedical image analysis problems that can be phrased as image-level classification, semantic segmentation, instance segmentation, or object detection task. The current version is based on a Delphi process on metrics conducted by an international consortium of image analysis experts from more than 60 institutions worldwide.Comment: This is a dynamic paper on limitations of commonly used metrics. The current version discusses metrics for image-level classification, semantic segmentation, object detection and instance segmentation. For missing use cases, comments or questions, please contact [email protected] or [email protected]. Substantial contributions to this document will be acknowledged with a co-authorshi

Understanding metric-related pitfalls in image analysis validation

Validation metrics are key for the reliable tracking of scientific progress and for bridging the current chasm between artificial intelligence (AI) research and its translation into practice. However, increasing evidence shows that particularly in image analysis, metrics are often chosen inadequately in relation to the underlying research problem. This could be attributed to a lack of accessibility of metric-related knowledge: While taking into account the individual strengths, weaknesses, and limitations of validation metrics is a critical prerequisite to making educated choices, the relevant knowledge is currently scattered and poorly accessible to individual researchers. Based on a multi-stage Delphi process conducted by a multidisciplinary expert consortium as well as extensive community feedback, the present work provides the first reliable and comprehensive common point of access to information on pitfalls related to validation metrics in image analysis. Focusing on biomedical image analysis but with the potential of transfer to other fields, the addressed pitfalls generalize across application domains and are categorized according to a newly created, domain-agnostic taxonomy. To facilitate comprehension, illustrations and specific examples accompany each pitfall. As a structured body of information accessible to researchers of all levels of expertise, this work enhances global comprehension of a key topic in image analysis validation.Comment: Shared first authors: Annika Reinke, Minu D. Tizabi; shared senior authors: Paul F. J\"ager, Lena Maier-Hei

Search for dark matter produced in association with bottom or top quarks in √s = 13 TeV pp collisions with the ATLAS detector

A search for weakly interacting massive particle dark matter produced in association with bottom or top quarks is presented. Final states containing third-generation quarks and miss- ing transverse momentum are considered. The analysis uses 36.1 fb−1 of proton–proton collision data recorded by the ATLAS experiment at √s = 13 TeV in 2015 and 2016. No significant excess of events above the estimated backgrounds is observed. The results are in- terpreted in the framework of simplified models of spin-0 dark-matter mediators. For colour- neutral spin-0 mediators produced in association with top quarks and decaying into a pair of dark-matter particles, mediator masses below 50 GeV are excluded assuming a dark-matter candidate mass of 1 GeV and unitary couplings. For scalar and pseudoscalar mediators produced in association with bottom quarks, the search sets limits on the production cross- section of 300 times the predicted rate for mediators with masses between 10 and 50 GeV and assuming a dark-matter mass of 1 GeV and unitary coupling. Constraints on colour- charged scalar simplified models are also presented. Assuming a dark-matter particle mass of 35 GeV, mediator particles with mass below 1.1 TeV are excluded for couplings yielding a dark-matter relic density consistent with measurements

Guidelines for the use and interpretation of assays for monitoring autophagy (3rd edition)

In 2008 we published the first set of guidelines for standardizing research in autophagy. Since then, research on this topic has continued to accelerate, and many new scientists have entered the field. Our knowledge base and relevant new technologies have also been expanding. Accordingly, it is important to update these guidelines for monitoring autophagy in different organisms. Various reviews have described the range of assays that have been used for this purpose. Nevertheless, there continues to be confusion regarding acceptable methods to measure autophagy, especially in multicellular eukaryotes. For example, a key point that needs to be emphasized is that there is a difference between measurements that monitor the numbers or volume of autophagic elements (e.g., autophagosomes or autolysosomes) at any stage of the autophagic process versus those that measure fl ux through the autophagy pathway (i.e., the complete process including the amount and rate of cargo sequestered and degraded). In particular, a block in macroautophagy that results in autophagosome accumulation must be differentiated from stimuli that increase autophagic activity, defi ned as increased autophagy induction coupled with increased delivery to, and degradation within, lysosomes (inmost higher eukaryotes and some protists such as Dictyostelium ) or the vacuole (in plants and fungi). In other words, it is especially important that investigators new to the fi eld understand that the appearance of more autophagosomes does not necessarily equate with more autophagy. In fact, in many cases, autophagosomes accumulate because of a block in trafficking to lysosomes without a concomitant change in autophagosome biogenesis, whereas an increase in autolysosomes may reflect a reduction in degradative activity. It is worth emphasizing here that lysosomal digestion is a stage of autophagy and evaluating its competence is a crucial part of the evaluation of autophagic flux, or complete autophagy. Here, we present a set of guidelines for the selection and interpretation of methods for use by investigators who aim to examine macroautophagy and related processes, as well as for reviewers who need to provide realistic and reasonable critiques of papers that are focused on these processes. These guidelines are not meant to be a formulaic set of rules, because the appropriate assays depend in part on the question being asked and the system being used. In addition, we emphasize that no individual assay is guaranteed to be the most appropriate one in every situation, and we strongly recommend the use of multiple assays to monitor autophagy. Along these lines, because of the potential for pleiotropic effects due to blocking autophagy through genetic manipulation it is imperative to delete or knock down more than one autophagy-related gene. In addition, some individual Atg proteins, or groups of proteins, are involved in other cellular pathways so not all Atg proteins can be used as a specific marker for an autophagic process. In these guidelines, we consider these various methods of assessing autophagy and what information can, or cannot, be obtained from them. Finally, by discussing the merits and limits of particular autophagy assays, we hope to encourage technical innovation in the field

Is it possible to teach history taking and physical examination by training?

Based on the criticism concerning traditional teaching methods, problem-based courses were introduced in the medical education of the University of Munich to foster the acquistion of action knowledge. One of these courses is the so-called MuSkel-course (course of musculosceletal diseases and injury). This course ends with a Triple Jump examination, the first step of which is an examination with a standardized patient in an OSCE-format (Objective Strutured Clinical Examination). In order to prepare the students for this exam, an OSCE-training was introduced with the fourth MuSkel-course. This study aimed at answering the question, to what extent this training exhibited a better knowledge. For that, the performance of students without training (control group) was compared with that of students having received two training sessions (experimental group). The results demonstrated that the experimental group performed better than the control group in only a few but important tests (identification of important points in medical history taking and clinical examination, the attitude towards the patient, the call for further diagnostic tests)